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[0037] The maximum is achieved when MV moves along 
the direction defined by (herein referred to as "the strong 
direction"), and the minimum is achieved when MV moves 
along the direction defined by (herein referred to as "the 
weak direction")- 

[0038] From Equation 2, each element in G can be 
expressed by Equation 4: 



8ij = ^<''k*"ik*Vjk 



Equation 4 



[0039] For a square system (i.e., where n=m), the rela- 
tionship defined by Equation 2 can be reversed as shown in 
Equation 5: 



Diag(Oi)=C/'*G*V 



Equation 5 



[0040] Given the threshold s>0, a model matrix has a rank 
of i(s) if: 

aj/ai>-j and a,+i/Oi<y. 

[0041] r(s)^0 and r(s)^m. If r(s)om, then the given 
system has a full rank and the matrix is not "coUinear If 
r(s)<m and a^=0, the system is "collinear" or "perfectly 
collinear." If r(s)<m and o^=0, then the system is "nearly 
collinear." 

[0042] A transformed input vector MT and a transformed 
output vector CT as follows: 



CT^U'^CV 



Equation 6 

Equation 6.1 



[0043] Then the transformed input and output variables 
have the following relationship: 

'«* iOi^ >»fy t»l yr~ Equation 7 

[0044] G(sm) is a square sub-matrix derived from G, 
where sm=l, . . . , p and p is the number of all possible 
square sub-matrices. 'Vhc dimension of G(sm) ranges from 
2x2, 3x3, . . . , to mxm. When dealing with coUinearity, the 
focus can be placed on square sub-matrices because if a nxm 
matrix is collinear (where n>m),then all its mxm sub- 
matrices must be collinear too. 

[0045] CoUinearity Detection 

[0046] For a given model matrix G, and a given threshold 
s, a search over all sub-matrices G(sm), where sm=l, . . . , 
p, is conducted and the sub-matrices are sorted into three 
groups: 1) a not collinear group, G„(sm); 2) a nearly 

collinear group, Gj,^(sm); and, 3) a collinear group, G^(sm). 

[0047] If the G„^(sm) group is empty, the method can be 
stopped. Alternatively, the threshold value can be modified 
and the method of the invention begun again. If the G„c(sm) 
group is not empty, the coUinearity of the sub-matrixes in 
that group is verified. 



[0048] CoUinearity Verification 

[0049] When a sub -matrix falls into the nearly collinear 
group, the available degree of freedom is then either recog- 
nized or ignored even though the extra capability may be 
limited. In order to determine the best course of action for 
a given application, the coUinearity can be verified. This 
verification includes determining whether the control action 
is acceptably aggressive for the needs of the given applica- 
tion, and controlling as described below: 

[0050] Control Action Magnitude 

[0051] When a system is nearly collinear, the associated 
control action for certain CV targets will be aggressive, since 
the control action is, to some extent, proportional to the 
response of the model inverse. The most significant magni- 
tude (in the sense of 2-norm) of MV change happens when 
the CV move along the weak direction, that is, 

CV=a*U^aeR Equation 8 

Equation 9 

[0052] a can be used as a scaling number so that the CV 
change wiU be in a desired range, and then the required MV 
change can be estimated from Equation 9. Based on the 

knowledge of the process, a practitioner can make a judg- 
ment if the control action required to achieve the targets is 
reasonable. If it is determined that the control action is 
desirable, then the near coUinearity is acceptable and no 
model adjustment is necessary. If it is determined that the 
action is not desirable, a directional test and identification is 
performed. 

[0053] Directional Test and Identification 

[0054] As shown in Equation 7, for a nearly collinear 
process, the transformed outputs cti,i=r+l, . . . , m wiU have 
a relatively small response to the transformed inputs mti,i= 
r+1, , . . , m. Moreover, their corresponding singular value 
a- is similar to the gain between the transformed input and 
the transformed output. This relationship provides an oppor- 
tunity to verify if the real process is the case, by employing 
the following procedure: 

[0055] 1. Perturb the system in such a way that the 
input signals foUow the direction specified by 11^,1- 
r+1, . . . , m. 

[0056] 2. Construct transformed input and outputs 
vectors mtj and ct£,i«r+l, . . . , m using the collected 
test data. 



[0057] 3. Identify model between mtj and ct^,i*'f i , . i 

[0058] 4. If the identified gain in the transformed 
space is close to and the uncertainty bound of the 
identified gain surrounds 0, then this portion of the 
process is deemed to be truly collinear; otherwise, it 
is deemed to be not colUnear. 

[0059] 5. The newly coUected test data is used to 
improve the model quality by rerunning the identi- 
fication because the newly collected data contains 
rich process responses in the weak direction. 

[0060] 6. Repeat the coUinearity detection with the 
improved model. 
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[0080] To address these concerns, the following optimi- 
zation formula is created: 



Minimize^ ^ igij - gm^^ 



[0081] subject to: 
[0082] 



Equation 10 



. ,m 



Constraint 10.1 



Constraint 10.2 



ndsin ) otCww ) 

J] 2j ^^"^^ * * vfi/isfn) <= <r-j ism) 
k^l 1=1 



[0083] G(0) represents the nominal model, G"^ and 0' 
represent the allowed upper and lower bound of the model. 
Oij" and a^^ are allowed upper and lower bound for the 
singular values. m(sm) is the dimension of the sub-matrix 
sm. p is the total number of nearly collinear sub-matrices 
G,,(sm). 

[0084] Equation 10 is the objective function. The objec- 
tive fumction minimizes deviation from the nominal model 
as long as the required perfect collinearlity can be achieved. 
Constraint 10.1 represents the allowed variation for each 
model element. Constraint 10.2 is contributed from each 
nearly collinear sub-matrix. All Uii(sm) andj^^f^are the 
singular vectors calculated from the original sub-matrix 
G„^(sm), and hence the same directionality is always main- 
tained. 

[0085] In some embodiments, o^f and Cy* are set to 

[0086] 1) aij"'(sm)=aij'^(sm)=0 if i^j, which corre- 
sponds to the off-diagonal portion of the singular 
value matrix; , 

07/ m)- (xTiCsm) = 0 

^ -^*-/ \ — ■»■/ \ r\':c • _/ 



[0092] Uncollinearization should satisfy the following 
requirements: 

[0093] 1. The repaired model should have the same 
directionality as the original model because chang- 
ing the direction can cause unwanted control prob- 
lems that can potentially result in a less desirable 
performance than with the original collinearity. 

[0094] 2. The directionality change should be made 
within allowed ranges. Additional restrictions can 
also be imposed, such as additional linear equality or 
inequality constraints. 

[0095] 3. When treating a model matrix larger than 
2x2, a collinear sub-matrix can share common ele- 
ments with another collinear sub-matrix. Such a case 
can result in a "zigzag game" or never ending loop, 
with repairs to one sub-matrix giving rise to a need 
for repairs to the other sub-matrix. Hence, the meth- 
odology should be able to deal with multiple sub- 
matrices in a synchronized way. 

[0096] To achieve these goals, the following optimization 
formula was created: 



p mism)~rism) 

Maximize^ ^ ia-^y^i / (r^^^iiO))^ 

^1 i=l 



Equation 11 



[0097] subject to: 



m{sm) 

i. y= 1, ... ytnims) 



Constraint 11.1 



Conat f aint 11.1 



af(5m)-<ai(OTi)<-ai*(5m), i-l, . , , , m{sm) Constraint 11.2 



responds to those small singular values to be zeroed 

[oois] 3) fl»:(am)_ i i,(n) T(-i riii) «nri ,T.^iOm) ifT,(n)Hi ■ 

jep^if i<=r(sm), where 0<eps<l is a constant. Choosing a 
large value for eps allows large variations in the singular 
values. Since the objective function always tries to find the 
minimal variation for the model matrix, it is expected that 
variation of the singular value will also be very mild. Hence, 
a small eps (for instance, eps«0.1) can be safely used. 

[0089] Finally, Equation 10 is a standard QP formula and 
can be solved globally and efficiently. 

[0090] Uncollinearization 

[0091] If the process is not collinear, or is nearly collinear 
but needs the controller to fully explore its capability, then 
adjustments to the model can be made to improve the 
condition number so that an improved robustness can be 
achieved. 



[0087] 2) ^f(3my"%j^(DmrQ' if i>r(sm), which cor- '^jiig)*Uikiq)*Vjkiq) = Yj^kiO*Uikit)*vjtitx 



k~i 



Constraint 11.3 



[0098] for those i j which point to the same element in G, 
sm, q, t»l, . . . ,p, q^t. 

[0099] gij"^ and gif denote the upper and lower bounds of 
the allowed model adjustment, af and o^'*' are upper and 
lower bounds on the singular values, o,^i{0) represents the 
original singular value, and m(sm) is the dimension of the 
sub-matrix sm. p is the total number of nearly collinear 
sub-matrices G„c(sm). Additional explanation of Equation 
11 is provided below. 

[0100] The objective function is to maximize the portion 
of the smaller singular values of all nearly collinear sub- 
matrices. The weighting factor, l/o^sm)^^P\ means the 
smaller the original singular value, the more improvement 
the optimizer will attempt to obtain. Constraint 11.1 repre- 
sents the allowed variation for each model element. All 
Ua,(sm) and Vj.i,(sm) (as well as Ua,(q), Vp,(q), Uii,(t), and 
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[0141] Let's consider a gain matrix shown below: 



-0.61 12 


-0.8705 


-0.8161 


-2.2515 


0 


0 


0 


0 


0 


0 


4.4013 


0 


-2.8114 


-5.3374 


-10.1706 


-30.0073 


1.8984 


1.8283 


0.1132 


0.0153 


0.1204 


0.0495 


0 


0 


-2.0609 


6.0295 


9.4035 


24.5094 


-1.6758 


-1.7359 


-0.154 


-0,0253 


-0.1818 


-0.0677 


0 


0 


-0.6244 


-1.4399 


-2.5429 


-7.4598 


0.4203 


0.4147 


0 


0.0091 


0.0456 


0.0187 


0 


-0.2577 


0.1446 


0.3026 


0.5424 


1.5888 


-0.0855 


-0.0843 


0 


-0.0016 


-0.0105 


-0.004 


0 


0.1572 


-1.7149 


-2.731 


6.9034 


17.5966 


-1.2014 


-1.2893 


0 


-0.0407 


-0.1277 


-0.0382 


0 


0 


.-0.0015 


-0.0034 


0.004 


0.0227 


0 


-0.0016 


0 


0 


0 


0 


0 


0 



[0142] Given a threshold of s«0.0001, the following three [0149] with singular values a«(3.44302 0) 
sub-matrices are identified to be collinear: 



6.0295 -1,73591 
-1.4399 0.4147 J' 



-2.81033 1.89821 1.82815 0.0153128 

-2.0605 -1.67583 -1.73614 -0.0254196 

-0.62416 0.420308 0.414617 0.00902449 

-1.71455 -1.20166 -1.28927 -0.0405464 



[0143] with singular values a-<0.831627 7.57818e-5) 



C2 = 



r -1.6758 -0.1818 
1-0.4203 0.0456 



[0150] with singular values a«<3.21072 1.89861 0.602891 
0) 

[0151] The uncollinearization result: 



[0144] with singular values a=(3.44311 6.69126e-5) 



r 5.56824 -1.596481 
^^'^1-1.32195 0.408456 J' 



C3 = 



-2.8114 1.8984 1.8283 0.0153 

-2.0609 -1.6758 -1.7359 -0.0253 

-0,6244 0,4203 0.4147 0.0091 

-1.7149 -1.2014 -1.2893 -0.0407 



[0152] with singular values a-(0.905079 0.0169216) 



C2' 



-1.5367 -0.1818 
-0.414725 0.0456 



[0145] /y values a-(3.2117 1.89876 0.60946 3.5965e-5) 

[0146] Assuming that each gain element is allowed to vary 
no more than 10% from its nominal value. 

[0147] The Collinearization results: 



[0153] with singular values o-(3.64152 0.0666536) 



C3: 



-3.09168 1.8772 1.79803 0.01377 

-2,11308 -1.5367 -1.59648 -0.02277 

-0,68684 0.414725 0.4O8456 0.00819 

-1.76702 -1.09372 -1.18305 -0.0400757 



_r 6.0302 - 1.73614 j 
"[-1.44011 0.414617 J' 



[0154] with singular values o-(3.23766 1.9333 0.648371 
0.00239357). 



[0148] with singular values aKO.831509 0) 



-1.67583 -0.181804 
-0.420308 0.0455975 



What is claimed is: 

1. A method of analyzing a model for Model Predictive 
Control, the method comprising the steps of: 

a) obtaining a model gain matrix of a subject model used 
for Model Predictive Control of a given process; 

b) identifying any near-collinear sub-matrices of the 
obtained model gain matrix; 



